Each score pertains to the combined test set of the language, without distinguishing individual treebanks and the enhancement types they annotate. The last line shows the macro-average over languages.
Language | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS |
Arabic | 99.97 | 94.57 | 81.67 | 91.87 | 89.54 | 89.66 | 89.29 | 90.58 | 79.39 | 75.54 | 72.73 | 67.43 | 69.29 | 72.91 | 70.96 |
Bulgarian | 99.89 | 99.89 | 93.63 | 99.17 | 97.40 | 98.06 | 96.91 | 98.30 | 94.46 | 91.83 | 89.09 | 86.11 | 86.87 | 90.40 | 89.42 |
Czech | 99.85 | 99.85 | 92.55 | 98.98 | 96.95 | 97.04 | 96.24 | 98.83 | 93.93 | 92.25 | 91.18 | 87.16 | 90.13 | 88.38 | 86.95 |
Dutch | 99.71 | 99.71 | 77.23 | 96.75 | 95.52 | 96.67 | 94.87 | 97.19 | 90.57 | 88.05 | 83.25 | 78.73 | 80.50 | 86.58 | 85.14 |
English | 99.22 | 99.22 | 81.19 | 96.21 | 95.47 | 96.18 | 93.71 | 96.88 | 89.21 | 86.94 | 84.37 | 78.78 | 81.92 | 86.02 | 85.21 |
Estonian | 99.70 | 99.70 | 88.02 | 97.45 | 98.10 | 96.43 | 95.16 | 95.18 | 88.69 | 86.20 | 84.96 | 80.31 | 79.78 | 84.70 | 81.03 |
Finnish | 99.69 | 99.68 | 88.52 | 98.11 | 56.30 | 96.81 | 54.70 | 92.12 | 91.97 | 90.31 | 89.07 | 85.13 | 80.01 | 87.79 | 86.24 |
French | 99.54 | 99.13 | 93.27 | 96.04 | 99.13 | 91.79 | 90.14 | 96.53 | 90.98 | 86.47 | 81.11 | 70.69 | 77.76 | 85.81 | 83.63 |
Italian | 99.90 | 99.82 | 96.29 | 98.46 | 98.34 | 98.15 | 97.58 | 98.50 | 94.74 | 93.09 | 89.61 | 86.84 | 87.77 | 91.99 | 90.83 |
Latvian | 99.34 | 99.34 | 98.36 | 96.69 | 90.25 | 94.52 | 89.64 | 96.28 | 90.69 | 87.96 | 85.85 | 78.45 | 82.60 | 84.51 | 82.11 |
Lithuanian | 99.94 | 99.94 | 87.46 | 96.57 | 91.05 | 91.67 | 90.13 | 94.29 | 84.91 | 81.54 | 79.84 | 69.95 | 74.25 | 77.61 | 75.89 |
Polish | 99.33 | 99.79 | 96.73 | 98.58 | 94.36 | 92.68 | 90.16 | 98.01 | 94.26 | 92.11 | 90.58 | 80.97 | 88.49 | 89.15 | 80.39 |
Russian | 99.48 | 99.48 | 97.93 | 98.80 | 99.48 | 97.76 | 97.58 | 98.26 | 94.41 | 93.31 | 92.24 | 89.93 | 90.75 | 90.97 | 89.84 |
Slovak | 99.99 | 99.99 | 84.06 | 97.16 | 88.14 | 92.89 | 87.02 | 96.63 | 91.20 | 89.06 | 87.37 | 78.03 | 83.73 | 86.17 | 84.36 |
Swedish | 99.72 | 99.72 | 88.02 | 97.51 | 95.64 | 89.01 | 87.69 | 93.39 | 88.65 | 85.91 | 84.28 | 69.67 | 77.72 | 84.36 | 83.27 |
Tamil | 99.49 | 94.96 | 93.83 | 87.41 | 80.36 | 83.56 | 78.79 | 90.09 | 71.85 | 66.23 | 63.71 | 54.37 | 59.75 | 65.68 | 64.23 |
Ukrainian | 99.79 | 99.75 | 95.31 | 98.03 | 94.69 | 94.74 | 93.70 | 97.47 | 90.72 | 88.59 | 85.98 | 79.26 | 83.38 | 85.46 | 84.64 |
Average | 99.68 | 99.09 | 90.24 | 96.69 | 91.81 | 93.98 | 89.61 | 95.80 | 89.45 | 86.79 | 84.42 | 77.75 | 80.86 | 84.62 | 82.60 |
The system output for each language was split into parts corresponding to individual source treebanks. The scores then ignore errors in enhancement types for which the treebank lacks gold-standard annotation. The column LAvgELAS shows the qualitative ELAS averaged over treebanks of the same language; the final average in bold is averaged over languages rather than treebanks. For comparison, the last column then shows the coarse ELAS F1 for the given language.
Treebank | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS | Enhancements | LAvgELAS | cf. |
Arabic-PADT | 99.97 | 94.57 | 81.67 | 91.87 | 89.54 | 89.66 | 89.29 | 90.58 | 79.39 | 75.54 | 72.73 | 67.43 | 69.29 | 72.91 | 70.96 | (no xsubj) | 70.96 | 70.96 |
Bulgarian-BTB | 99.89 | 99.89 | 93.63 | 99.17 | 97.40 | 98.06 | 96.91 | 98.30 | 94.46 | 91.83 | 89.09 | 86.11 | 86.87 | 90.40 | 89.42 | 89.42 | 89.42 | |
Czech-FicTree | 99.98 | 99.98 | 91.58 | 98.61 | 93.36 | 94.60 | 92.30 | 99.08 | 94.79 | 93.09 | 91.84 | 82.54 | 90.64 | 88.58 | 87.17 | 86.00 | 86.95 | |
Czech-CAC | 99.97 | 99.97 | 99.52 | 99.38 | 97.06 | 97.09 | 96.35 | 98.76 | 95.41 | 93.75 | 92.62 | 88.56 | 91.21 | 88.43 | 87.07 | 86.00 | 86.95 | |
Czech-PDT | 99.89 | 99.89 | 92.07 | 99.19 | 97.56 | 97.59 | 96.99 | 99.02 | 94.09 | 92.57 | 91.64 | 88.38 | 90.67 | 88.78 | 87.41 | 86.00 | 86.95 | |
Czech-PUD | 99.28 | 99.28 | 94.18 | 97.19 | 94.39 | 94.06 | 92.66 | 96.85 | 90.88 | 87.60 | 85.40 | 78.62 | 83.93 | 84.40 | 82.35 | (no codepend) | 86.00 | 86.95 |
Dutch-Alpino | 99.49 | 99.49 | 88.66 | 97.09 | 95.90 | 97.12 | 95.33 | 97.08 | 93.20 | 90.83 | 87.15 | 82.79 | 84.13 | 89.37 | 88.03 | 85.20 | 85.14 | |
Dutch-LassySmall | 99.92 | 99.92 | 68.45 | 96.42 | 95.16 | 96.25 | 94.43 | 97.29 | 88.04 | 85.40 | 79.64 | 74.98 | 77.14 | 83.92 | 82.38 | 85.20 | 85.14 | |
English-EWT | 98.80 | 98.80 | 73.96 | 96.02 | 95.65 | 96.38 | 94.53 | 97.37 | 87.43 | 85.23 | 82.28 | 78.11 | 80.88 | 84.41 | 83.72 | 85.34 | 85.21 | |
English-PUD | 99.71 | 99.71 | 94.99 | 96.42 | 95.26 | 95.95 | 92.73 | 96.30 | 91.31 | 88.95 | 87.00 | 79.62 | 83.23 | 87.92 | 86.96 | 85.34 | 85.21 | |
Estonian-EDT | 99.94 | 99.94 | 89.14 | 97.88 | 98.51 | 96.97 | 95.85 | 95.55 | 89.62 | 87.24 | 86.01 | 81.78 | 80.95 | 86.22 | 82.70 | (no xsubj) | 78.00 | 81.03 |
Estonian-EWT | 98.55 | 98.55 | 81.23 | 95.42 | 96.13 | 93.82 | 91.84 | 93.39 | 84.26 | 81.22 | 79.84 | 73.15 | 74.09 | 77.60 | 73.31 | (no codepend, no xsubj) | 78.00 | 81.03 |
Finnish-TDT | 99.71 | 99.70 | 86.58 | 98.04 | 98.55 | 96.50 | 95.75 | 92.02 | 91.31 | 89.65 | 88.49 | 84.17 | 79.32 | 86.46 | 84.85 | 86.62 | 86.24 | |
Finnish-PUD | 99.65 | 99.64 | 91.40 | 98.21 | 0.00 | 97.22 | 0.00 | 92.26 | 92.84 | 91.19 | 89.82 | 86.40 | 80.92 | 89.87 | 88.39 | (no codepend, no xsubj) | 86.62 | 86.24 |
French-Sequoia | 99.73 | 99.03 | 86.10 | 98.08 | 99.03 | 97.40 | 96.90 | 97.83 | 92.32 | 90.66 | 88.15 | 85.21 | 86.82 | 89.19 | 88.11 | (no gapping, relcl, case) | 85.48 | 83.63 |
French-FQB | 99.47 | 99.17 | 94.63 | 95.18 | 99.17 | 89.46 | 87.31 | 95.99 | 90.42 | 84.72 | 78.19 | 64.66 | 74.00 | 84.26 | 82.86 | (no gapping, relcl, case) | 85.48 | 83.63 |
Italian-ISDT | 99.90 | 99.82 | 96.29 | 98.46 | 98.34 | 98.15 | 97.58 | 98.50 | 94.74 | 93.09 | 89.61 | 86.84 | 87.77 | 91.99 | 90.83 | 90.83 | 90.83 | |
Latvian-LVTB | 99.34 | 99.34 | 98.36 | 96.69 | 90.25 | 94.52 | 89.64 | 96.28 | 90.69 | 87.96 | 85.85 | 78.45 | 82.60 | 84.51 | 82.11 | 82.11 | 82.11 | |
Lithuanian-ALKSNIS | 99.94 | 99.94 | 87.46 | 96.57 | 91.05 | 91.67 | 90.13 | 94.29 | 84.91 | 81.54 | 79.84 | 69.95 | 74.25 | 77.61 | 75.89 | 75.89 | 75.89 | |
Polish-LFG | 98.63 | 99.89 | 99.22 | 98.75 | 95.00 | 92.76 | 89.90 | 98.54 | 95.67 | 93.83 | 92.72 | 83.02 | 91.18 | 92.96 | 83.03 | (no gapping) | 80.71 | 80.39 |
Polish-PDB | 99.45 | 99.82 | 95.29 | 98.85 | 94.55 | 92.41 | 89.94 | 98.17 | 93.95 | 91.81 | 90.28 | 80.19 | 88.33 | 88.30 | 80.21 | 80.71 | 80.39 | |
Polish-PUD | 99.60 | 99.65 | 95.63 | 97.98 | 93.54 | 93.12 | 90.73 | 97.33 | 93.81 | 91.43 | 89.63 | 80.96 | 86.93 | 88.08 | 78.88 | 80.71 | 80.39 | |
Russian-SynTagRus | 99.48 | 99.48 | 97.93 | 98.80 | 99.48 | 97.76 | 97.58 | 98.26 | 94.41 | 93.31 | 92.24 | 89.93 | 90.75 | 90.97 | 89.84 | 89.84 | 89.84 | |
Slovak-SNK | 99.99 | 99.99 | 84.06 | 97.16 | 88.14 | 92.89 | 87.02 | 96.63 | 91.20 | 89.06 | 87.37 | 78.03 | 83.73 | 86.17 | 84.36 | 84.36 | 84.36 | |
Swedish-Talbanken | 99.87 | 99.87 | 96.52 | 98.43 | 97.33 | 97.38 | 96.51 | 97.83 | 91.76 | 89.47 | 87.80 | 83.51 | 85.28 | 87.78 | 86.70 | 83.14 | 83.27 | |
Swedish-PUD | 99.57 | 99.57 | 78.32 | 96.53 | 93.85 | 80.08 | 78.28 | 88.65 | 85.32 | 82.12 | 80.51 | 54.86 | 69.62 | 80.69 | 79.58 | 83.14 | 83.27 | |
Tamil-TTB | 99.49 | 94.96 | 93.83 | 87.41 | 80.36 | 83.56 | 78.79 | 90.09 | 71.85 | 66.23 | 63.71 | 54.37 | 59.75 | 65.73 | 64.28 | (no gapping, xsubj, relcl) | 64.28 | 64.23 |
Ukrainian-IU | 99.79 | 99.75 | 95.31 | 98.03 | 94.69 | 94.74 | 93.70 | 97.47 | 90.72 | 88.59 | 85.98 | 79.26 | 83.38 | 85.46 | 84.64 | 84.64 | 84.64 | |
Average | 99.61 | 99.27 | 90.21 | 97.07 | 91.40 | 94.18 | 88.89 | 96.06 | 90.31 | 87.78 | 85.55 | 78.64 | 82.06 | 85.46 | 83.07 | 82.52 |